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ABSTRACT 



The present invention comprises a method and apparatus for 
manipulating screen objects utilizing multiband regions of 
influence. Positioning a reference point of an object within 
a particular band invokes a particular functionality or opera- 
tion related to that band. In one embodiment, three types of 
functionality are provided. Moving a reference datum (for 
example, a line representing an edge or a user defined 
reference point) of an object A into a first band of an object 
B places object A under the influence of object B's gravity, 
causing object A to be pulled into precise alignment with 
object B. Moving the reference point of object A from the 
first band into a second band turns off object B's gravity, 
allowing object A to be freely moved to any arbitrary 
position near the object B. Moving the reference point of the 
object A to a position outside all bands causes object B's 
gravity function to be turned back on. In other embodiments, 
the bands of the invention provide other kinds of function- 
alities or operations. For example, one embodiment com- 
prises bands that provide different types of precise position- 
ing. In one embodiment, multiple bands are provided, each 
one causing objects to be positioned so as to be spaced apart 
by one of several precise, predetermined distances. 

16 Claims, 15 Drawing Sheets 
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METHOD AND APPARATUS FOR SCREEN 
OBJECT MANIPULATION 

This is a continuation of application Ser. No. 09/004,233 
filed Jan. 8, 1998, now U.S. Pat. No. 6,088,027. 5 

BACKGROUND OF THE INVENTION 

1. Field of the Invention 

The present invention relates to the manipulation of 
objects displayed on a display screen, and more particularly 
to a method and apparatus for positioning objects using 10 
direct manipulation. 

2. Background Art 

FIG. 1 shows an example of two objects, object A 100 and 
object B 105, displayed on a display device such as a 
computer display screen. The objects may, for example, be 
objects created with a graphics editing program. Objects 
such as object A 100 and object B 105 that are displayed on 
a display screen may be referred to as "screen objects." The 
screen objects shown in FIG. 1 are simple rectangles. 
However, screen objects can have any size and shape. 
Further, a screen object may consist of a group of different 
objects. For example, a screen object may comprise a 
bit-mapped image combined with a vector-based drawing 
object. A screen object may also represent other objects or 
data, such as, for example, a sound clip or video data. 25 

A user often desires to manipulate screen objects such that 
they are precisely located or precisely dimensioned with 
respect to other objects on the screen. For example, a user 
may desire to position an object such that one or more of its 3Q 
edges coincide with one or more edges of another object, as 
shown in FIG. 2, or such that one or more of its edges are 
positioned close to but spaced apart from another object, as 
shown in FIG. 3. A user may also wish to resize an object 
such that the object has the same height and/or width as 35 
another object, as shown in FIG. 4. 

A number of approaches to the precision location and 
precision sizing of screen objects have been developed in the 
prior art. 

One approach, used in drawing programs such as 40 
MacDraw (™) and Claris Works (™), is to provide 
precision-location and precision-sizing commands. To use 
these commands, a user must first select the objects in 
question, for example by positioning a cursor over each 
object and clicking a mouse button. Next, the user must 45 
invoke the desired command, for example by hitting an 
appropriate hot key or key combination on a keyboard or by 
selecting the command using pull-down menus. Finally, the 
user must enter information regarding the manner in which 
the user wants to position or resize the object into a dialog 50 
box that opens after the command is activated. FIG. 5 shows 
an example dialog box for the "align" menu command from 
MacDraw(™). 

Although using precision location and precision sizing 
commands allows the user to position or size objects, the 55 
multiple steps required to use these commands are incon- 
venient. 

A second approach uses a technique sometimes referred to 
as "gravity." In this approach an object, around its edges, is 
provided with a "region of influence" that exerts a pull on 60 
other objects that come into the region. FIGS. 6-9 illustrate 
the operation of the prior art gravity technique. In FIG. 6, a 
dotted rectangle 600 indicates the region of influence for the 
left edge of object B 105. FIG. 6 also shows a mouse cursor 
605 positioned over object A 100. A user may move object 65 
A 100 by selecting and "dragging" object A 100 with a 
mouse. 
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In the gravity approach, when a first object (such as object 
A 100) is dragged so that one of its edges enters the region 
of influence of an edge of a second object (such as object B 
105), the first object is automatically "snapped" to the 
second object such that the edges of the two objects meet. 
FIG. 7 shows object A 100 after it has been moved hori- 
zontally to the right such that its right edge enters region of 
influence 600 of object B 105. Once the right edge of object 
A 100 enters region of influence 600, object A 100 is 
snapped to the right such that its right edge is aligned with 
the left edge of object B 105, as shown in FIG. 8. In this prior 
art example, if mouse cursor 605 is dragged far enough 
further to the right, object A 100 once again becomes 
"unstuck" from object B 105, as shown in FIG. 9. 

Although the gravity technique of the prior art is useful 
when a user wants to align objects such that their edges 
coincide, it prevents the user from arbitrarily positioning 
objects close to one another. As soon as an edge of a first 
object enters a second object's region of influence, the first 
object is snapped into alignment with the second object. 
Prior art gravity systems thus provide for easy alignment, 
but at the cost of preventing arbitrary positioning of objects 
close to one another. 

SUMMARY OF THE INVENTION 

The present invention comprises a method and apparatus 
for manipulating screen objects utilizing multiband regions 
of influence. Positioning a reference datum of an object 
within a particular band invokes a particular functionality or 
operation related to that band and to that datum. 

In one embodiment, three types of functionality are pro- 
vided. Moving a reference point or datum (for example, a 
line representing an edge or a user-defined reference point) 
of an object A into a first band of an object B places object 
A under the influence of object B's gravity, causing object 
A to be pulled into precise alignment with object B. Moving 
the reference point of object A from the first band into a 
second band turns off object B's gravity, allowing object A 
to be freely moved to any arbitrary position near the object 
B. Moving the reference point of the object A to a position 
outside all bands causes object B's gravity function to be 
turned back on. By providing multiple bands of 
functionality, this embodiment allows a user to conveniently 
select among precise positioning (or sizing) provided by 
gravity and arbitrary positioning (or sizing) allowed by an 
absence of gravity, simply by dragging an object's reference 
point into an appropriate band. No menu commands are 
required. 

In other embodiments, the bands of the invention provide 
other kinds of functionalities or operations. For example, 
one embodiment comprises bands that provide different 
types of precise positioning. In one embodiment, multiple 
bands are provided, each one causing objects to be posi- 
tioned so as to be spaced apart by one of several precise, 
predetermined distances. 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 shows a first arrangement of two example screen 
objects. 

FIG. 2 shows a second arrangement of the screen objects 
of FIG. 1. 

FIG. 3 shows a third arrangement of the screen objects of 
FIG. 1. 

FIG. 4 shows a fourth arrangement of the screen objects 
of FIG. 1. 
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FIG. 5 shows a dialog box of an alignment command of specific details are set forth in order to provide a more 

the prior art. thorough description of the invention. It will be apparent, 

FIG. 6 shows an example of a region of influence of the however, to one skilled in the art, that the invention may be 

prior art. practiced without these specific details. In other instances, 

FIG. 7 shows the operation of the region of influence of 5 well-known features have not been described in detail so as 

FIG. 6. not to obscure the invention. 

FIG. 8 shows the operation of the region of influence of piG. 10 shows an example embodiment of a multiband 

region of influence of the invention. In FIG. 10, a multiband 

FIG. 9 shows the operation of the region of influence of reg j on 0 f influence 1001 comprising bands 1005, 1010 and 

io 1015 is shown extending outwards adjacent to left edge 

FIG. 10 shows an embodiment of a multiband region of 1045 0 f a fi^ s^en object B 1000. Dotted lines are used 

influence of the invention. t0 show mu ltiband region of influence 1001 in FIG. 10 to 

FIG. 11 shows an example of a reference datum for an indicate that multiband region of influence 1001 is not 

object being moved in one embodiment of the invention. normally displayed to a user. FIG. 10 also shows a second 

FIG. 12 shows the operation of the multiband region of is screen object A 1030 located to the left of object B 1000, and 

influence of FIG. 10. a horizontal coordinate axis 1020. Coordinate axis 1020 is 

FIG. 13 shows the operation of the multiband region of provided to indicate relative horizontal positions. For 

influence of FIG. 10. example, the right edge 1040 of object A 1030 is located at 

FIG. 14 shows the operation of the multiband region of coordinate "cA" on axis 1020, while the left edge 1045 of 

influence of FIG. 10. 20 object B 1000 is located at coordinate "eB " For the example 

FIG. 15 shows a state transition model for one embodi- of RG - 10 » 0D j ect A 1030 k initially constrained to move 

ment of the invention. horizontally only. However, no such constraints are neces- 

FIG. 16 shows an embodiment of a multiband region of sar y t0 P ract i<* the invention, 
influence of the invention. In the example of FIG. 10, multiband region of influence 

FIG. 17 shows an embodiment of a multiband region of 25 ^ associated with an edge, namely left edge 1045, of object 

influence of the invention. B 1000. However, in other embodiments, the multiband 

FIG. 18 shows an embodiment of a multiband region of re S ion of influence of the invention may be associated with 

influence of the invention. ^ otner reference points of a screen object, including user 

FIG. 19 shows an embodiment of a multiband region of 30 defined refereQce P oints - 
influence of the invention. In lhe example of FIG. 10, multiband region of influence 

FIG. 20 shows how datum lines for a n object being 1001 co^P"** three bands 1005, 1010 and 1015, respec- 

moved are determined in one embodiment of the invention. tivel y* M shown m Fia 10 ' band 1015 extends outwards a 

HO. 21 shows how datum lines for an object being moved d f ance * * om ft ! e c ft ed f 1( " 5 of ° b J ect B j 000 

are determined in one embodiment of the invention. 35 ed S c / band 10 / A 5 * ^ Io u cat f d at ~itotle - 'eB on 

ttt^ -v>u uj. i f , coordinate axis 1020, while the left edge of band 1015 is 

FIG. 22 shows how datum lines for an object being moved , , . # , , , n . „ n Jin f A , c 

M . # . , . ... . J . * located at coordinate "eB-ks." Band 1010 extends from the 

are determined in one embodiment of the invention. kft ^ of bafld lQl5 al ^ CQQTdin , ic 

FIG. 23 shows the operation of one embodiment of a » Band 10Q5 extends from ^ lcft ed of band 

multiband region of mfluence of the invention. 1Q10 at « cb _ w > t0 « eB _fo« 

FIG. 24 shows the operation of one embodiment of a In the fc of HQ 1Q object A mo fa be moyed 

multiband region of influence of the invention. d mnn t 1 u «j j 

np . f f , _ r adjacent to object B 1000, for example by "drag and 

FIG. 25 shows the operation of one embodiment of a dropping" with a mouse. To drag and drop object A, a mouse 

multiband region of influence of the invention. & used t0 position a ausot 1050 over object A 1Q30 A 

FIG. 26 shows the operation of one embodiment of a 4J . mouse button is then depressed, locking the cursor onto 

multiband region of influence of the invention. object A 1030 at the spot at which the mouse button was 

FIG. 27 is an example of one embodiment of a computer depressed. The cursor is then moved to a new location, 

system that can be used to implement the invention. "dragging" object A with it. At the new location, the mouse 

FIG. 28 is a flow chart showing the operation of one button is released, thereby "dropping" object A 1030 at the 

embodiment of the invention. 50 new location. 

FIG. 29 shows an example of a datum line used with an The process of dragging and dropping an object may be 

embodiment of a multiband region of influence of the displayed to a user in a number of ways, depending on the 

invention when an object is being resized. embodiment of the user interface being used. In certain 

FIG. 30 shows an example of the user interface of a sound embodiments, the object is shown to move with the cursor 

editing program that uses an embodiment of the invention. 55 in real time. In other embodiments, the object remains in 

FIG. 31 shows an example of how the reference datum place, and an outline representing the object moves with the 

and regions of influence of the invention may be used with cursor to indicate the object's new location. For the process 

the embodiment of FIG. 30. of the invention, any representation of drag-and -dropping 

FIG. 32 shows an example of non-rectilinear objects used mav De use d- 
with an embodiment of the invention. 60 In one embodiment, a reference datum representing the 

FIG. 33 illustrates the operation of the embodiment of position of one or more edges of an object being moved with 

FIG. 32. respect to a cursor location is used to determine whether the 

ncTAiT cn nccrDTDnmi ™r -nrc functionality associated with a multiband region of influence 

DETAILED OTSCR^ON OF THE fa tQ ^ iflVoked , Q Qther em5odiments> omer and/or addi . 

65 tional reference datums may be used. In one embodiment, 

A method and apparatus for manipulation of screen the user may define reference datums for a screen object, 

objects is described. In the following description, numerous Different functionalities may be associated with different 
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datums, or with different ways of selecting a datum. For invoke a change of an object or objects from one state to 

example, selecting a datum by clicking a left mouse button another, or may apply some other function or action, 

may invoke a different functionality, when the datum is For example, in one embodiment, as shown in FIG. 15, 

moved inside a region of influence, than selecting the datum there are three possible states when one object ("object A") 

by clicking a right mouse button. In one embodiment, for an 5 ^ being dragged with respect to another object ("object B"). 

object having multiple reference datums, the datum closest i n slale 1 1500, object B's "gravity" is turned on. However, 

to the cursor position when the mouse button is clicked is object A is located outside of object B's region of influence 

deemed to be the active datum whose position relative to a an d is therefore freely movable (not stuck to object B). In 

region of influence invokes the functionality associated with slate 2 1510, object A, under the influence of object B's 

the region. 10 gravity, has become stuck to object B. In state 3, object B's 

In FIG. 10, at the time the mouse button is depressed, gravity has been turned off, and object A, accordingly, is not 

cursor 1050 is located on object A 1030 at coordinate "mO" stuck to object B and is freely movable even within object 

on horizontal coordinate axis 1020. Since the right edge B's region of influence. 

1040 of object A 1030 is located at coordinate "eA," the \ Q t h e state model of FIG. 15, there are three possible state 

horizontal distance of right edge 1040 from cursor 1050 at « transitions: (i) from state 1 to state 2 (object A falls within 

this time is Aa=eA-m0. Right edge 1040 of object A 1030 pu n 0 f object B's gravity and becomes stuck to object B); 

is thus located a distance Aa to the right of cursor 1050. („) fr 0m state 2 to state 3 (object B's gravity is turned off, 

FIG. 11 shows mouse cursor 1050 after it has moved allowing object A to move freely in vicinity of object B); and 

horizontally to the right from its position at coordinate "mO" (iii) from state 3 to state 1 (object B's gravity is turned back 

in FIG. 10 to coordinate "m" on coordinate axis 1020. 20 on, object A being outside object B's region of influence). 

Reference datum 1100 represents a reference datum for right The state transitions of the embodiment of FIG. 15 may 

edge 1040 of object A 1030. Since right edge 1040 of object be associated with the multiband regions of influence of the 

A 1030 was located a distance Aa to the right of cursor 1050 invention in a variety of ways. The state transitions of the 

when the mouse button was depressed, reference datum line embodiment of FIG. 15 may, for example, be associated 

1100 is defined to be located at horizontal coordinate 25 ^h bands 1005, 1010 and 1015 of FIG 14 

«m + Aa" when the mouse cursor is positioned at horizontal [n Qne embodiment? the Nation* between the state 

coordinate transitions and bands 1005, 1010 and 1015 are as follows: 

As mouse cursor 1050 is moved, the value of its hori- L Wfaen reference datum ^ nm f object fa 

zontal coordinate m is monitored. Using this > value the 3Q QUtside Qbject „ 100Q , S ^ of influence ir j 01 (i e datum 

coordinate "m + Aa for reference datum line 1100 * calcu- lme U0Q J is DQt ^ Q f b{mds m Q Q * ^ 

lated. The value of coordinate "m+Aa' is compared to the , ■ ^ n 11 . . ' A - . ♦ » 1 t » * 1 a \ 

c . , _ , , „ /wv _ - Mttk r , _ _ shown in FIG. 11, objectAisin state 1. In state l,eA=m+Aa. 

coordinates of the edges of bands 1005, 1010 and 1015 of „ . . ' J ^ 

region of influence 1001 to determine whether any func- 2. A transition from state 1 to state 2 occurs in band 1015, 

tionality related to region of influence 1001 is to be applied. „ lhe band closcst t0 ob J ect B 1000 ' 0b J ect A 1030 lhus sta y s 

FIGS. 12, 13 and 14 illustrate how reference datum line 1100 m state 1 untl1 cursor 1050 > 35 shown " FIG 14 > » moved 

falls successively into bands 1005, 1010, and 1015 of such thal datum line 1100 enters band 1015 («■ ( m+Aa ) 

multiband region of influence 1001 as cursor 1050 is moved >eB-ks). At this point, object A 1030 transitions to state 2, 

to the right. As shown in FIG. 12, reference datum line 1100 becoming stuck to object B 1000 such that right edge 1040 

falls into band 1005 when (eB-kr)<(m+Aa)<(eB-ku). As M of ob J ecl A 1030 coincides with left edge 1045 of object B 

shown in FIG. 13, reference datum line 1100 falls into band 1000 In stale 2 > therefore, eA-eB. 

1010 when (eB-ku)<(m+Aa)<(eB-ks). And as shown in 3 - A transition from state 2 to state 3 occurs in band 1005. 

FIG. 14, reference datum line 1100 falls into band 1015 To turn off object B 1000's gravity such that object A 1030 

when (eB-ks)<(m+Aa)<eB. becomes unstuck and free positionable near object B 1000, 

The bands of the region of influence of the invention can 45 cursor J* 50 musl be moved 51100 ^ l datum line 1100 enters 

have a variety of configurations. Bands may be contiguous band 1005 * 0nce the transition from state 2 to state 3 has 

as in the embodiment of FIG. 10. Alternatively, they may occurred, datum line 1100 can be moved back into band 

overlap, be separated, or be arranged in some other manner. wlthout ob ^ { A 1030 stuck to object B 
Bands may be associated with one or more external bound- 

aries of an object, and/or with one or more other external or 50 4 - A transition from state 3 back to state 1 occurs beyond 

internal points or features of an object. For example, in one the outermost band of region of influence 1001. If object A 

embodiment that allows a user to establish multiple user- 1030 is in state 3 (unstuck, object B 1000's gravity off), and 

defined reference datums for an object, bands of influence it is desired for object A 1030 to be stuck to object B 1000, 

may be associated with each of the user-defined reference datum line 1100 must first be moved beyond the outermost 

datums. 55 band (i.e. band 1005) of region of influence 1001 (to rum 

The multiband regions of influence of the invention can ob J ect B 1000 ' s 8 ravitv back on )' and 10(511 back band 

be used to invoke a variety of functionalities, depending on 1015 < such lhat ob J ect A 1030 bec °mes stuck to object B 

the embodiment. In one or more embodiments, the particular 1000 under influence of object B 1000's gravity), 

functionality invoked may depend not only on the location 1° this embodiment, no state transitions or other function- 

of a reference datum, but also on the identity and type of the 60 aut Y is associated with band 1010. Accordingly, the same 

datum, on the type of operation being performed (e.g. functionality can be provided by the multiband region of 

moving, resizing, etc.), on the direction of datum line influence 1600 of FIG. 16, which includes two bands 1605 

movement, on whether the right or left mouse button has an ^ 1610 spaced apart by a distance of ku-ks. 

been clicked or a keyboard key has been depressed, on the In the embodiments of FIGS. 10 and 16, objects were 

states of objects being manipulated, and/or on other criteria. 65 constrained to move horizontally and a multiband region of 

The functionality invoked by a region of influence of the influence of the invention was shown to extend outwardly in 

invention may apply an action to an object or objects, may only one direction from only one edge of a screen object. In 
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the more general case, objects may be moved in any 2000. However, mother embodiments, the length of a datum 

direction, and the multiband region of influence extends to line may be different from the length of the corresponding 

both sides of each edge of a screen object. FIGS. 17-19 object edge. For example, in FIG. 22, datum lines 2105, 

show different example configurations of the multiband 2110, 2115 and 2120 extend indefinitely, 

region of influence of the invention. 5 FIGS 23 _ 26 demonstrate the interaction of the datum 

In the embodiment of FIG. 17, multiband region of unes of nG 21 ^ lhe multiband reg ions of influence of 

mfluence 1700, like multiband region of influence 1600 of ^ 19 in Qne embodiment of the invention. In the embodi- 

V * \ ^ CO ??T S H tWO iS2S f < n inni ? ^S^ 8 meDl of mGS - 23 ^ 26 ' the functionality invoked by regions 

to the left of left edge 1045 of object B 1000. In addition, f . fl . , . . . 3 c . . . . J . & . , 

multiband region of influence 1700 includes two bands 10 of / nfl f ue | nce t0 verticri [ ^ of objects is mvoked 

1710* and 17056 extending to the right of edge 1045. In this 30 °^ * ?™?* n ° f a vert,cal ?* tum ^ of . an ^ ect 

embodiment, bands 17106 and 17056 are mirror images of moved ^lls into the region, while the functionality mvoked 

bands 1710a and 1705c, respectively, and have the same by regions of influence related to honzontal edges of objects 

associated functionalities. k mvoke d only if a11 or part of a horizontal datum line of an 

In the embodiment of FIG. 18, multiband region of ob J ect bein S moved faUs mi0 the K & on - 

influence 1800 consists of two bands 1805 and 1810 to the 15 For example, in FIG. 23, cursor 2025, originally posi- 

left of left edge 1045 of object B 1000 and one band 1815 tioned on object 2000 as shown in FIG. 20, has been moved, 

to the right of edge 1045. In this embodiment, each of the alon g with tne datum knes 2105, 2110, 2115, and 2120 such 

bands 1805, 1810 and 1815 may have different associated datum line 2120 (corresponding to top edge 2020 of object 

functionalities. In one embodiment, for example, using the 2000) protrudes into band 1930d of multiband region of 

state model of FIG. 15, band 1810 invokes a transition from 20 influence 1930 (relating to bottom edge 1935 of object 

state 1 1500 to state 2 1510, while band 1815 invokes a 1900), and datum line 2105 (corresponding to left edge 2005 

transition from state 2 1510 to state 3 1520, and band 1805 of object 2000) protrudes into band 1910c of multiband 

invokes a transition from state 3 1520 to state 1 1500. region of influence 1910 (relating to left edge 1915 of object 

FIG. 19 shows an object 1900 that has multiband regions 5 

of influence 1910, 1920, 1930, and 1940 associated with In the embodiment of FIG. 23, using the state model of 

each of its sides 1915, 1925, 1935 and 1945, respectively. FIG. 15, bands c and d of each region of influence invoke a 

Each multiband region of influence 1910-1940 includes six transition from state 1 1500 to state 2 1510, bands a and f 

bands a, b, c, d, e and f . The bands invoke certain specified invoke a transition from state 2 1510 to state 3 1520, and the 

functionalities on objects whose datum lines enter into one 3Q region outside of bands a-f invokes a transition from state 3 

or more of the bands. Objects in the embodiment of FIG. 19 1520 to state 1 1500. In this embodiment, bands b and e do 

are not constrained to move horizontally or vertically, but not invoke any functionality. Accordingly, when cursor 2025 

can move in any direction. In one embodiment, using the of FIG. 20 is located as shown in FIG. 23: 

state model of FIG. 15, bands c and d invoke a transition 1. Because datum line 2120 protrudes into band 1930rf, a 

from state 1 1500 to state 2 1510, bands a and f invoke a 35 change in state from state 1 1500 to state 2 1510 is invoked 

transition from state 2 to state 3, and the region outside of with respect to bottom edge 1935 of object 1900 and top 

bands a-f invokes a transition from state 3 to state 1. In this edge 2020 of object 2000. If the mouse button is released 

embodiment, bands b and e do not invoke any functionality. while cursor 2025 is in this position, the top edge 2020 of 

FIGS. 20 and 21 show how datum lines are established for object 2000 becomes "stuck" (aligned), in a vertical 

use with multiband regions of influence in one embodiment ^ direction, to the bottom edge 1935 of object 1900. 

of the invention. FIG. 20 shows an object 2000 with left 2. Because datum line 2105 protrudes into band 1910c, a 

edge 2005, bottom edge 2010, right edge 2015, and top edge change in state from state 1 1500 to state 2 1510 is invoked 

2020. The datum lines are established, for example, when a with respect to left edge 1915 of object 1900 and left edge 

mouse cursor is positioned over an object and a mouse 2005 of object 2000. If the mouse button is released while 

button is pressed and held. 45 cursor 2025 is in this position, left edge 2005 of object 2000 

FIG. 20 shows a mouse cursor 2025 after it has been becomes "stuck" (aligned), in a horizontal direction, to the 

positioned over object 2000 and its mouse button has been left edge 1915 of object 1900. 

pressed. At the moment the mouse button is pressed, the The resulting placement of object 2000 with respect to 

distance of cursor 2025 from each of the edges 2005, 2010, object 1900 is shown in FIG. 24. 

2015 and 2020 is determined. As shown in FIG. 20, the 50 A user may, however, desire to turn off the gravity 

distances from cursor position 2025 to each of edges 2005, associated with one or more edges of object 1900 so that one 

2010, 2015 and 2020 at the time the mouse button is pressed or more edges of object 2000 can be placed close to one or 

are Aa, Ab, Ac and Ad, respectively. more sides of ob j ect 1900 without being stuck to that side. 

Datum lines are established at locations that correspond to In the embodiment of FIG. 23, gravity with respect to an 

the position of edges 2005, 2010, 2015 and 2020 relative to 55 edge of object 1900 is turned off by moving the appropriate 

cursor position 2025 at the time the mouse button is pressed, datum line from band cord into band a or f of the multiband 

as shown in FIG. 21. FIG. 21 shows cursor 2025 after it has region of influence associated with that edge. For example, 

been moved, keeping the mouse button pressed, from its to turn off the gravity with respect to left edge 19 15 of object 

original position in FIG. 20. As shown in FIG. 21, the datum 1900, cursor 2025 is moved from the location shown in FIG. 

lines for edges 2005, 2010, 2015 and 2020 move along with 60 23, at which datum line 2105 extends into band 1910c, to the 

cursor 2025 as cursor 2025 is dragged to a new position. In location shown in FIG. 25, at which datum line 2105 extends 

FIG. 21, datum line 2105 corresponds to edge 2005, datum into band 1910a, thereby causing the gravity associated with 

line 2110 corresponds to edge 2010, datum line 2115 cor- left edge 1915 of object 1900 to be turned off. If cursor 2025 

responds to edge 2015, and datum line 2120 corresponds to is now moved back to the location shown in FIG. 23, and the 

edge 2020. 65 mouse button released, top edge 2020 of object 2000 will 

In the embodiment FIG. 21, the length of each datum line still be stuck, in a vertical direction, with bottom edge 1935 

is the same as the length of the corresponding edge of object of object 1900 (because gravity with respect to bottom edge 
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1935 is still on, and datum line 2120, corresponding to top 
edge 2020 of object 2000 still extends into band 1930</). 
However, because gravity associated with left edge 1915 of 
object 1900 has been turned off, left edge 2005 object 2000 
will not become stuck to left edge 1915 of object 1900 even 5 
though datum line 2105 extends into band 1910c. Instead, 
left edge 2005 of object 2000 will be located at the same 
horizontal position as the horizontal position of datum 2105 
in FIG. 23. The resulting position of object 2000 with 
respect to object 1900 is shown in FIG. 26. ^ 

The present invention can be implemented by means of 
software programming on any of a variety of one or more 
computer systems as are well known in the art, including, 
without limitation, computer systems such as that shown in 
FIG. 27. The computer system shown in FIG. 27 includes a JS 
CPU unit 2700 that includes a central processor, main 
memory, peripheral interfaces, input-output devices, power 
supply, and associated circuitry and devices; a display 
device 2710 which may be a cathode ray tube display, LCD 
display, gas-plasma display, or any other computer display; 2Q 
an input device 2730, which may include a keyboard, 
mouse, digitizer, or other input device. The computer system 
may or may not include non-volatile storage 2720, which 
may include magnetic, optical, or other mass storage 
devices, and a printer 2750. The computer system may also 25 
include a network interface 2740, which may consist of a 
modem, allowing the computer system to communicate with 
other systems over a communications network such as the 
Internet. Any of a variety of other configurations of com- 
puter systems may also be used. 3Q 

FIG. 28 is a flow chart showing the operation of one 
embodiment of the invention. As shown in FIG. 28, the 
activation of a mouse button is awaited at step 2805. When 
a mouse button is activated, notification of the mouse button 
activation is received at step 2810. At step 2815, a deter- 35 
mination is made as to whether the mouse cursor is posi- 
tioned over an object (such as, for example, object 2000 of 
FIG. 20) on a display screen. If it is determined that the 
cursor is not positioned over an object, processing returns to 
step 2805. 40 

If it is determined that the cursor is positioned over an 
object, the identity and location of the applicable reference 
datum is determined at step 2820. For example, for an object 
for which no other reference datums other than its external 
boundaries have been established, in one embodiment, the 45 
applicable reference datum will be the object's external 
boundaries. Alternatively, if the object has other reference 
datums other than its external boundaries, one or more 
applicable datums are determined using appropriate criteria. 
In one embodiment, for example, the reference datum near- 50 
est the cursor position when the mouse button is clicked is 
selected as the applicable datum. A variety of other criteria 
may also be used. 

At step 2825, the initial state of the object at the time the 
mouse button is clicked is determined. In one embodiment, 55 
the initial state is deemed to be state 3 of FIG. 15: namely, 
the object is not currently stuck to any other object, and the 
gravity associated with any immediately adjacent object is 
off. In another embodiment, the initial slate of the object is 
the state of the object that resulted from any immediately 60 
prior manipulation of the object. For example, if the object 
was previously manipulated so as to become stuck to 
another object (state 2), then the initial state at step 2825 is 
also state 2. In other embodiments, other criteria may be 
used to establish the initial state. 65 

At step 2830, further mouse operations are monitored. At 
step 2835, a determination is made as to whether the mouse 
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has moved. If not, at step 2840, a determination is made as 
to whether the mouse button has been released. If the mouse 
button has been released, the current state of the object is 
determined at step 2843, and the object is redrawn at the 
appropriate location determined by the position of the cursor 
and the current state at step 2845. If the mouse button has not 
been released, processing returns to step 2830. 

If a determination is made at step 2835 that the mouse has 
moved, a determination is made whether any applicable 
reference datum has entered an applicable band of a multi- 
band region of influence at 2850. Such a determination may 
be made, for example, by determining whether the a refer- 
ence datum identified at block 2820 falls in an applicable 
band. In one embodiment, if the applicable datum comprises 
the vertical and horizontal edges of the external boundary of 
a rectangular object, an applicable band is a band related to 
a vertical side of a stationary object for the vertical portions 
of the reference datum for an object being moved, and a 
band related to a horizontal side of a stationary object for the 
horizontal portions of the datum for the object being moved. 
If it determined that no reference datum has entered an 
applicable band, processing returns to step 2830. 

If it is determined at step 2850 that a reference datum has 
entered into an applicable band, then the current state for 
that band and that datum is determined at block 2855. The 
current state may, for example, be maintained in a look-up- 
table listing objects, datums, and states. The current state 
may, for example, be one of the states of FIG. 15. 

At step 2860, a determination is made as to whether the 
event of the datum entering the band necessitates a change 
in state. Whether or not a change in state is required depends 
on the current state and the particular band the datum has 
entered. For example, in the embodiment of FIG. 19, if the 
current state is state 1 1500 of FIG. 15, and a vertical datum 
line of the object being moved has entered band 1910a, 
1910/?, 1910e, or 1910f, for example, no change in state is 
needed. However, if a vertical datum line of an object in 
state 1 enters into either of bands 1910c or 1910^, a change 
in state is invoked from state 1 to state 2. 

If no change in state is required, processing returns to step 
2830. If a change in state is required, that change is made 
and the new state recorded at step 2865. Processing then 
returns to step 2830. 

FIG. 29 shows an example of a datum 2910 used with the 
multiband region of influence of the invention when an 
object is being resized, as opposed to being moved. To resize 
an object, a cursor 2915 is used to select an edge (or in some 
embodiments a resizing "handle") 2925 of the object 2935 
being resized. Only the edge 2925, not the entire object 
2935, moves when the edge is dragged to a new desired 
position. Datum line 2910 is located at the mouse cursor 
position and extends parallel to the edge 2925 that has been 
selected for resizing. The location of edge 2925 once the 
mouse button is released during resizing is determined from 
current state of edge 2925 in relation to a multiband region 
of influence and the position of the datum line 2910 at the 
time the mouse button is released in the same manner as the 
location for the edge of an object being moved is determined 
as described with respect to FIGS. 19-26. However, in the 
case of resizing, instead of the object being moved to match 
the new edge position, the object is stretched (or 
compressed) to accommodate the new edge position. 

FIG. 30 shows an example of the user interface of a sound 
editing program that uses an embodiment of the invention. 
FIG. 30 shows a display screen 3000 that contains two audio 
tracks 3001 and 3002. The horizontal axis of display screen 
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3000 represents time. Audio track 3001 contains a screen 
object 3005 that represents a first sound clip. Audio track 
3002 contains a screen object 3010 that represents a second 
sound clip. The relative horizontal positions of screen 
objects 3005 and 3010 represent the points in time during 5 
which the sound clips represented by the screen objects play 
during playback. 

Screen object 3005 includes a name area 3015, a wave 
area 3025, and a sync point area 3020. Screen object 3010 
also includes a name area 3045, a wave area 3050, and a 10 
sync point area 3040. 

Name area 3015 displays the name of the sound clip 
represented by screen object 3005. Wave area 3025 shows a 
representation of the sound wave represented by screen 
object 3005. Sync point area 3020 shows user-created sync 15 
points, such as sync point 3030. In one embodiment, a user 
may create a sync point by clicking in the sync point area of 
a screen object at the desired horizontal location of the sync 
point and activating an appropriate pull-down menu com- 
mand. " 20 

In the embodiment of FIG. 30, screen objects 3005 and 
3010 may be moved, using a pointing device such as a 
mouse, horizontally along audio tracks 3001 and 3002, 
respectively. Screen objects may also be moved from one 25 
track to another. In one embodiment, a screen object may be 
moved by positioning a mouse cursor in either the name area 
or the sync area, and dragging the object to the desired 
location. A screen object can be constrained to remain in a 
track by, for example, holding down a shift key on a 3Q 
keyboard while dragging. 

When a screen object is being moved in the example of 
FIG. 30, multiband regions of influence are activated with 
respect to each vertical side and each sync point of the other 
screen objects displayed on the screen, as shown in FIG. 31. 35 
In FIG. 31, screen object 3005 is being moved. Accordingly, 
multiband regions of influence 3130, 3120, and 3125 are 
activated with respect to the left and right edges and sync 
point 3035 of screen object 3010, respectively. 

In the embodiments of FIGS. 30 and 31, the applicable 40 
reference datum for the screen object being moved is 
determined by the location of the mouse cursor when the 
drag operation is begun (i.e. when the mouse button is 
clicked). In the embodiment of FIGS. 30 and 31, a screen 
object drag operation can be begun by positioning the cursor 45 
in either the name area or the sync point area of the screen 
object being dragged. If the cursor is positioned in the name 
area of the screen object at the beginning of a drag operation, 
the left or right edge of the screen object that is nearest to the 
cursor position establishes the reference datum applicable to 50 
that drag operation. If the cursor is positioned in the sync 
point area, the nearest sync point establishes the reference 
datum. 

For example, in the embodiment of FIG. 31, if, at the 
beginning of a drag operation, the cursor is located at 55 
position 3100 in name area 3015 of screen object 3005, the 
nearest left or right edge of screen object 3005 is the left 
edge. Accordingly, reference datum 3105 is established at 
the horizontal location of the left edge of screen object 3005. 
Alternatively, if, at the beginning of a drag operation, the 60 
cursor is located at position 3110 in sync point area 3020, the 
nearest sync point is sync point 3030. Accordingly, reference 
datum 3115 is established at the horizontal location of sync 
point 3030. The interaction of reference datums 3105 or 
3115 with multiband regions of influence 3130, 3125, and 65 
3120 allows an edge or sync point of one screen object to be 
precisely aligned with an edge or sync point of another 
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screen object, or to be positioned close to but not precisely 
aligned with an edge or sync point of the other screen object, 
as desired by the user, in the same manner as described with 
respect to the other embodiments of the invention. 

FIGS. 32 and 33 show examples of non-rectilinear objects 
used in one embodiment of the invention. FIG. 32 shows a 
stationary non-rectilinear object 3200 and a moving non- 
rectilinear object 3220. In the example of FIG. 32, object 
3200 is an oval and object 3220 is a circle. However, objects 
3200 and 3220 can have any arbitrary shape. In the example 
of FIG. 32, stationary object 3200 has an associated multi- 
band region of influence 3210. Moving object 3220 has an 
associated reference datum 3230, which may, for example, 
have been designated by a user. Multiband region of influ- 
ence 3210 comprises bands 3212, 3214 and 3216 which 
may, for example, have the same functionality as bands 
1805, 1810 and 1815, respectively, of the embodiment of 
FIG. 18. FIG. 32 shows object 3220 being moved towards 
object 3200, for example by being dragged with a mouse. 

According to the invention, if object 3220 is moved such 
that reference datum 3230 enters band 3214 of multiband 
region of influence 3210, object 3200's gravity is turned on, 
and object 3220 is pulled towards object 3200 such that 
reference datum 3230 of object 3220 coincides with the 
outside edge (i.e. the periphery) of stationary object 3200. 
Position "A" in FIG. 33 indicates the resulting relative 
positions of objects 3200 and 3220. If, for example, a user 
now drags object 3220 to the left in a generally horizontal 
direction, object 3220 will remain stuck to object 3200 and 
move along the periphery of object 3200 (e.g. from position 
"A" to position "B") as long as the conditions for object 
3220 being "stuck" to object 3200 (e.g. reference datum 
3230 remains in band 3214 of multiband region of influence 
3210) continue to be met. However, as in the embodiment of 
FIG. 18, if object 3220 is moved such that reference datum 
3230 enters band 3216, object 3200's gravity is turned off, 
and object 3220 becomes unstuck from object 3200. 

Thus, a method and apparatus for manipulating screen 
objects has been described. Although the invention has been 
described with respect to certain example embodiments, it 
will be apparent to those skilled in the art that the present 
invention is not limited to these specific embodiments. For 
example, although the multiband region of influence has 
been described with respect to two-dimensional, rectangular 
screen objects, the multiband region of influence of the 
invention can be used with three dimensional screen objects 
and with objects of any shape. Further, although the opera- 
tion of certain embodiments has been described in detail 
using certain detailed process steps, some of the steps may 
be omitted or other similar steps may be substituted without 
departing from the scope of the invention. Other embodi- 
ments incorporating the inventive features of the invention 
will be apparent to those skilled in the art. 

What is claimed is: 

1. In a computer system, a method for manipulating 
objects displayed on a display screen comprising: 

providing a first screen object having a plurality of 
regions of influence, said plurality of regions of influ- 
ence further comprises providing a plurality of over- 
lapping regions of influence; 

providing a plurality of influence actions associated with 
said first screen object; 

providing a plurality of influence states, wherein each of 
said plurality of influence actions is associated with at 
least two of said plurality of influence states; 

invoking a first set of transitions within said plurality of 
influence states, if a second screen object is moved 
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from a first region of influence to a second region of 
influence; and 

invoking a second set of transitions within said plurality 
of influence states, if said second screen object is 
moved from said second region of influence to said first 5 
region of influence. 

2. The method of claim 1 wherein said providing said 
plurality of regions of influence further comprises providing 
a plurality of juxtaposed regions of influence. 

3. The method of claim 2 wherein said providing said 10 
plurality of juxtaposed regions of influence further com- 
prises providing a plurality of concentric bands of influence. 

4. The method of claim 1 wherein said providing said 
plurality of influence actions further comprises aligning said 
first screen object and said second screen object. 15 

5. The method of claim 1 wherein said plurality of 
influence states comprise an active state and an inactive 
state. 

6. The method of claim 1 further comprising: 

selecting a second screen object; 20 
establishing a reference datum for said second screen 
object; 

moving said reference datum such that at least a portion 
of said reference datum protrudes into said first region 2 s 
of influence; 

invoking one of said plurality of influence actions corre- 
sponding to said first region of influence. 

7. The method of claim 6 wherein said invoking one of 
said plurality of influence actions further comprises invok- 30 
ing at least one of said plurality of influence actions depend- 
ing on a type of at least one of said first screen object and 
said second screen object. 

8. The method of claim 1 wherein said first set of 
transitions and second set of transitions are dissimilar. 35 

9. A computer program product comprising: 

a computer usable medium comprising computer readable 
code embodied therein for manipulating objects dis- 
played on a display screen, said computer program 
product configured to: 40 
provide a first screen object having a plurality of 
regions of influence, said computer readable code 
configured to cause said computer to provide said 
plurality of regions of influence further comprises 
computer readable code configured to cause said 45 
computer to provide a plurality of overlapping 
regions of influence; 
provide a plurality of influence actions associated with 

said first screen object; 
provide a plurality of influence states, wherein each of 50 
said plurality of influence actions is associated with 
at least two of said plurality of influence states; 
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invoke a first set of transitions within said plurality of 
influence states, if a second screen object is moved 
from a first region of influence to a second region of 
influence; 

invoke a second set of transitions within said plurality 
of influence states, if said second screen object is 
moved from said second region of influence to said 
first region of influence. 

10. The computer program product of claim 9 wherein 
said computer readable code configured to cause said com- 
puter to provide a plurality of regions of influence further 
comprises computer readable code configured to cause a 
computer to provide a plurality of juxtaposed regions of 
influence. 

11. The computer program product of claim 10 wherein 
said computer readable code configured to cause said com- 
puter to provide said plurality of juxtaposed regions of 
influence further comprises computer readable code config- 
ured to cause said computer to provide a plurality of 
concentric bands of influence. 

12. The computer program product of claim 9 wherein 
said computer readable code configured to cause said com- 
puter to provide said plurality of influence actions further 
comprises aligning said first screen object and said second 
screen object. 

13. The computer program product of claim 9 wherein 
said plurality of influence states comprise an active state and 
an inactive state. 

14. The computer program product of claim 9 further 
comprising computer readable program code configured to 
cause said computer to: 

select a second screen object; 

establish a reference datum for said second screen object; 
move said reference datum such that at least a portion of 

said reference datum protrudes into said first region of 

influence; 

invoke one of said plurality of influence actions corre- 
sponding to said first region of influence. 

15. The method of claim 9 wherein said computer read- 
able code configured to cause said computer to invoke one 
influence action of said plurality of influence actions further 
comprises computer readable code configured to cause said 
computer to invoke said influence action depending on a 
type of at least one of said first screen object and said second 
screen object. 

16. The computer program product of claim 9 wherein 
said first set of transitions and second set of transitions are 
different. 

***** 
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